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Abstract 

This work studies the Jacobians of certain singular transformations and the corre- 
sponding measures which support the jacobian computations. 

1 Introduction 



First consider the following notation: Let Cm,N{q) be the linear space of all x m real 
matrices of rank q < min(A^, m) and C^_^ n(^) linear space of all TV x m real matrices 

of rank q < min(A^, m), with q distinct singular values. The set of matrices Hi G C^.n 
such that H'^Hi = is a manifold denoted Vm,N, called Stiefel manifold. In particular, 
Vm,m is the group of orthogonal matrices 0{m). Denote by iSm, the homogeneous space of 
mxni positive definite symmetric matrices; and by iS+(q), the (mg — (/(q — l)/2)-dimensional 
manifold of rank q positive semidefinite m x m symmetric matrices with q distinct positive 
eigenvalues. 

Assuming that X G £^ at (9); iDiaz-Garcfa et ai ( 1997 ) proposed the Jacobian of non- 
singular part of the singular value decomposition, X = HiDW'^, where Hi G Vg_7v, D 
is a diagonal matrix with Di > D2 > ■ ■ ■ Dg > and Wi G Vg_,„. Also, note that the 
jacobian itself defines the factorization of Hausdorff's measu re (dX) (or Lebesgue's mea- 



sure defined on the manifold C, 



m,N 



(9), 



see 



Billingslev (Il986l p. 249)). Analo gous results 



for V G tS+ fq) consideri ng t he non-singular part of the spectr al decomposition of V were 
posed by Uhlie ll 19941) and Diaz-Garcia and Gutierrez (Il997l). Based on these two res ults. 



pro 



Diaz-Garcia and Gutierrez- Jaimez (|2005') and D faz-Garcfa and Gutierrez- Jaimea (I2OO6I) com- 
puted the jacobians of the trans formations Y = X+ and W = V+, where A+ denotes the 
Moore-Penrose inverse of A, see iRaol (Il973l p.49). 

In the present work, assuming that X G C^j^{q), we proposed the Jacobian of non- 
singular part of the singular value decomposition assuming multiplicity in the singular values 
of X and the corresponding Jacobian of Y = X+ under the same conditions. Analogous 
results for V G ^^(q) and W = V+ considering the non-singular part of the spectral 
decomposition of V are proposed assuming multiplicity in the eigenvalues of V and/or 
assuming that V is a indefinite singular matri x. Also we wi l l determ ine the explicit measures 
with respect the jacobians are computed, see iDiaz-Garcia (|2007bh . 
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2 Jacobian of symmetric matrices 



Consider again A G Sm, it remains to study: A as a (nonsingular) indefinite matrix, i.e. 
A G iS^(mi, TO2), with rrii + m2 = m, where mi is the number of positive eigenvalues and 
7712 is the number of negative eigenvalues; and A as a (singular) semi-indefinite matrix, i.e. 
A G 5,^(9, <Zi, 92), with qi + q2 = q, here qi is the number of positive eigenvalues and (72 is 
the number of negative eigenvalues. 

First suppose A S S^{mi,m2) such that A = HDH', where H G 0{m), D is a diagonal 



matrix. Without loss of generality, let Ai > 
explicitly 

" Ai ••• 



> > and > -61 > ■ ■ ■ > -S„ 



H 









-Si 



H'. 



^ •■• ■ 
Now let A G 53=^(1, 2) and let A = HDH' be its SD, then 

dA = dHDH' + HdDH' + HDdH', 
thus by the skew symmetry of H'c?H we have, see iMuirhead (|l98l p. 105) 

H'dAH = H'dHD + dT> + DdH'H = H'dHD + dT> - DH'dH 



Moreover, 
H'rfAH = 





h'^dhi 



—h^dhi —h'^dhi 




h'n dho 



h'^dh2 




Ai 





Ai 










Xihi^dhi 
Xih'^dhi 



5ih'2dhi 


—Sih'^dh2 



52h'^dhi 
S2h'-^dh2 






-Si 





-S2 

dXi 








-52 





h'^dhi 


-dSi 




dAi 
-dSi 


— /ijrf/ii —h'^dhi 


h'^dh2 




~d52 






d52 



h'^dh2 







(Ai 
(Ai 



dAi 

- 5i)h'2dhi 

- S2)h'^dhi 



— Ai/ijrf/ii —Xih'-^dhi 
^5ih'2dhi Sih'jdh2 

—S2h'^dhi —52h'^dh2 

Si)h'2dhi [Xi + 52)h'^dhi 
—dSi {S2 — Si)h'jdh2 

i-Si + 52)h'r^dh2 -dd2 



(Ai 



We know that (H'dAH) = (dA), then a column by column computation of the exterior 
product of the subdiagonal elements of H'dHD + dG — DH'rfH gives, ignoring the sign. 



(dA) = (Ai + 5i){Xi + 52){-Si + ^2) A A '^J^^' A dAi A ~dSi A ~dS2. 

\i=i j=i+i J 

Recall that, if for example, the first element in each column of H is nonnegative, so, the 
transformation A = HDH' is 1 — 1. Then the corresponding jacobian must be divided by 



2 



2™, see lMuirheadI (|l982i pp. 104-105). Thus we have 

(rfA) - 2-3(Ai + 5i)(Ai + 52)(5i - <52)(H'dH) A (dD), 
where (H'dH) is the Haar measure on 0{m) and 

m 

(H'dH) = /\ /i^d/i^, (dD) = dXi A d^i A d52, 

this is, (dD) is a exterior product of all differentials dXi and (i(5j ignoring the sign. 
Analogously, if A e 5^(2, 1), 

(dA) = 2-^{Xi - A2)(Ai + 5i)(A2 + (5i)(H'dH) A (dD). 

Similarly, let A e 5^(2,2), then 

(dA) = 2-4(Ai - A2)((5i - (52)(Ai + (5i)(Ai + ^2)(A2 + 5i)(A2 + 52)(H'dH) A (dD). 

By mathematical induction we have 

Theorem 2.1. Let A G 5^(mi,TO2) smc/i that A = HDH', where H G (^(m), D is a 
diagonal matrix with Ai > • • ■ > Xmi > and > — (5i > • • ■ > —5^^, mi + m2 = Then 

rni mi mi,m2 

(dA) = 2-™ [](A, - A,) Y[{6, ~ 6,) Y[ (A, + ^,)(H'dH) A (dD). 



i<j 



i<l 



where 

mi ,7712 



rni 7712 



n =nn(^'+'^j)' (H'dH)=/\/i;d/i„ (dD)=/\dA, /\d,5,. 

i=ij=i i<j i=i j=i 



2J 



A similar procedure for A G 5,^j(g, qi, (72) gives: 

Theorem 2.2. Let A G S^{q,qi,q2) such that A = HiDH'j^. where Hi G Vq^m, D is o 
diagonal matrix with Ai > • • • > Ag^ > a77.d > —Si > ■ ■ ■ > —Sq^, qi + q2 — q- Then 



11 



92 



91 



91 



91:92 



(dA) = 2-^ n n '^r'' n(^« - ^^■) n('^' - n + 5.)(H'dH) a (dD). 



where 

91:92 



91 92 



7n 9 



91 92 



n(^^+'^j)^nn(^«+'^j)' (H'irfHi)=/\ /\ /i;d/i,, (dD)=/\dA, /\d^,. 

z— 1 J — 1 i—l J — 1 



3 Jacobians of symmetric matrices with multiplicity in 
its eigenvalues 

As a motivation of this section, consider a general random matrix A G g^™^*'"^ explicitly 

an • • • aim 



A = 



Any density function of this matrix can be expressed as 

dFA(A) = /A(A)(dA), 

where {dA) denotes the measure of Lebesgue in m"' , which can be written by using the 
exterior product, as 

m m 

{dA) = /\ /\da.,, 

1=1 j=i 



see 



MuirheadI (|l982l ). 



However, if A G Sm and it is non singular, then the measure of Lebesgue defined in iS„ 
is given by 



(dA) = /\ da,j. 

i<j 



(1) 



Remark 3.1. Note that the above product is the measure of Haus dorff on W" defin ed on 
the homogeneous space of positive definite symmetric matrices, see iBiUineslevI (Il986l) 

In general, we can consider any factorization of the Lebesgue measure (dA) on Sm 
as an alternative definition of (dA) with respect to the corresponding coordinate system. 
For example, if we consider the spectral decomposition (SD), A = HDH', where H G 
0{m), and D is a diagonal matrix with Di > ■ ■ ■ > Dm > or we consider the Cholesky 
decomposition A = T'T, where T is upper-triangular with positive diagonal elements, then 
we have respectively 



(dA) = < 



2-™]^(D, - £)j)(H'dH) A (dD), Spectral decomposition; 

i<j 
m 

2"'JJi;^'+i-'(dT), Cholesky decomposition, 



1=1 



see 



Diaz-Garcia and Gonzalez-FariasI ( 2005a ) , where 



(H'dH) = /\ h'jdh,, (dD) = /\ dD, and (dT) = /\ dUj. 

i<j z=l i<j 

In some occasions is difficult to establish an explicit form of the Lebesgue o Hausdorff 
measures in the original coor dinate system. Iii parti cular if A £ S^Iq) some unsuccessful 
efforts have been trailed, see Srivastaval ( 20031) an d Diaz-Garcia ( 2007a ). A definition of 
such measure in terms of the SD is given bv lUhhd (|1994|) : 



(dA) = 2-«]jl?r-«n(A - Z?,)(HidHi) A (dD), 

i=i i<j 

where Hi G Vq.m, D is a diagonal matrix with Di > • ■ • > Dq > and 



(2) 



(H'ldHi) = A A '^'i'^^^' (^°) ^ A ^^'5 

i=l j=i+l 



1=1 



for alte rnati ve expressions of (dA) in terms of o t her fac torizations see Diaz-Garcia and Gonzalez-Fariad 
( 2005a ) and Diaz-Garcia and Gonzalez-Fariad (2005b). 
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Now suppose that one (or more) eigenvalue(s) of A G Sm has (have) multiphcity. Then 
consider A = HDH', where H G ©(m), D is a diagonal matrix with Di > ■ ■ ■ > Dm > 0. 
Moreover, let Dk^ , . . . -Dfe, be the I distinct eigenvalues of A, i.e. Dk^ > ■ ■ ■ > Dk, > 0, where 
rrij denotes the repetitions of the eigenvalue Dk , j = 1, 2, . . . , ^, and of course mi + • • ■ m; = 
to; finally denote the corresponding set of matrices by A e 5^. It is clear that A exists in 
the homogeneous subspace of the symmetric matrices with dimension TO(m + l)/2 of rank to; 
more accurately, when there exist multiplicity in the eigenvalues, A exists in the manifold 
of dimension ml — I {I — l)/2, even exactly for computations we say that A G S^H)- For 
proving it, consider the matrix B G 1S2, such that S — HDH', here H G 0{2), and D is a 
diagonal matrix with Di > D2 > where Di = D2 = k, then the measure 



2 



(dB) = 2-2]J(£). _ Dj)(ll'dli) Adn = 2-^{k - K)(H'dH) A dD = 0. 

i<j 

Also note that, in fact the measure (tiD) — dDi A dD2 — dn A dn = 0. This is analogous to 
the following situation, to propose for a curve in the space (9^^) the measure of Lebesgue 
defined by da; 1 A dx2- 

Now, when we consider the factorization of the measure of Lebesgue in terms of the 
spectral decomposition, we do not have 2(2 + l)/2 = 3 but only 2(1) — 1(1 + l)/2 + 1 = 2 
mathematical independent elements in B, because in D, Di = D2 = k and then there is 
only one mathematical independent element. 

Also, observe that the space of positive definite to x to matrices is a subset of Euclidian 
space of symmetric to x to matrices of dimension to(to + l)/2, and i n fact it forms an open 
cone described by the following system of inequalities, see Muirheadl (|l982l p. 61 and p. 77 
Problem 2.6): 



A > an > 0,det 



On ai2 

0-21 0,22 



>0,--- ,det(A) >0. (3) 



In particular, let to = 2, after factorizing the measure of Lebesgue in Sm by the spectral 
decomposition, the inequalities ([3]) are as follows 

A > 4=> Di > 0, ZJa > 0, D1D2 > 0. (4) 

But if Di = D2 = K, ^ it reduces to 

A > ^ K > 0, > 0. (5) 

Which defines a curve (a parabola) in the space, over the line Di = D2{— k) in the subspace 
of points {Di,D2)- 

A similar situation appear in the following cases: i) When we consider multiplicity of the 
singular values in the SVD; such set of matrices will be denoted by X G at (9)7 Q > I', or 
by X G ^{q, I) q > I', ii) If we consider multiplicity in the eigenvalues; the corresponding 
set of matrices will be denoted by A G Sm{q, I), q > I', iii) And if A is nonpo sitive definite 



Thus, unfortunately, we must qualify as incorrect the asseverations of I Zhang (|2007r ) 
about the validity of his Lemmas 2, 3 and consequences, under multiplicity assumptions of 
singular values and eigenvalues. 

As a summary we have the next results, which collect the m ain conclusions of Section 



and th e present section, and follow a similar proof of Theorem 1 in Diaz-Garcia and Gutierrez-Jaime3 
(|2006f ): 



Theorem 3.1. Consider Y G Cm,N{q) and Y — X+, then 

k 

(dY) =[]a,r2(^+™-'=)(dX) 



i=l 



5 



where X = HiDc^P']^ is the nonsingular part of SVD of X., with Hi S Vk,N, Pi G Vk,Tn, 
Do- = diag(cri, . . . , ak), ai > ■ ■ ■ > ak > 0, the measure {dX.) is 

k k 

(dX) = 2-'^naf +™-''^) n(a2 - a|)(H;ciHi) A (P'^Pi) A (dD,), 

and 

\ I, Xe£+^(Q,0. 

Similarly, for symmetric matrices we have, 
Theorem 3.2. Let V e yi"^^"^ be a symmetric matrix and let W = V"*", then 
1. 

{dw) = \{\\^\-^^+^-\d^r), 

i=l 

where V = HiD^H'^ is the nonsingular part of SD of V, with Hi G V/3,jv, = 
diag(Ai, . . . , A/3), |Ai| > • • • > |A/3| > 0, the measure {dV) is 

{dV) = H IX-r-^Hm - |A,|)(HidHi) A {dT>^), 

i—1 i<j 



and 



a-- 



m, V or —V € Sm', 

I, V or -V e 5^; 

q, V or -V G S+{q}; 

k, y or-Y GS+{q,k). 



2. 



(rfW) = Y[xf^"'-"^^'-''^+'^Y[6-'^"'-^"-'^/'\dV), 

i=i i=i 

where a = ai + Q!2, V = HiDH'j^ is f/ie nonsingular part of SD ofV, with Hi G Va.N , 
D = diag(Ai,...,Aai,-(5i,...,-(5ai), Ai > • • • > Aa^ > 0; |i5i| > ••• > Ida^l > 0, the 
measure (dV) is 

cti a2 tti CKi a]_.cx2 

(dv) = 2-" n Af"" n ^r^" n(^^ - n('^* - n + ^.•)(H'rfH) a (^d). 

i=i j=i i<i 

and 

m, V G iS,t(™ii'™2); 
I, VG5±ai,^2); 

«> V G 5^ (9,51,^2); 

and V G 5,f((/i,Z2) denotes a nonsingular indefinite matrix with multiplicity in its 
eigenvalues and V G S^{q, k\,k2) denotes a singular indefinite matrix with multiplicity 
in its eigenvalues. 



a 
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4 Conclusions 



This work determines the jacobians of the SVD and the SD under multiphcity of the singular 
values and eigenvalues, respectively. For the SD case, we compute the jacobian for nonsin- 
gular and singular indefinite matrices with and without multiplicity in their eigenvalues. 
Also, we calculate the jacobians for a general matrix and its Moore-Penrose inverse, and 
for a symmetric matrix with all its variants (nonpositive, nonnegative and indefinite). In 
every case we specify the measures of Hausdorff which support the jacobian computations. 
Th ese results de tecte and correct some incons i stence s in the validity of Lemmas 2 and 3 
bv IZhantd (|2007t) . this is, the proofs in I Zhang (|2007r) for Lemmas 2 and 3 are valid only 
when all the nonzero singular values or eige nvalues are distinct and for positive or n ega- 
tive semidefinite matrices, as it is assume d in lDiaz-Garcia and Gutierrez- Jaimez (l2005l) and 
Diaz-Garcia and Gutierrez- Jaimez (|2006^ We highlight that the results of this paper will 
be the foundations of an explored problem in literature: the test criteria in MANOVA when 
there exist multiplicities in: the matrix of sum of squares and sum of products, due to the 
hypothesis Sh, the matrix of sum of square an d sum of p roducts, due to the error S^; the 
matrices S/fS^^; {Sh + SEy^Sn; see iDiaz-Gardal (|20Q8t ). 
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